The phrase "to visit the town" means to go to a particular place and explore or spend time in that place.